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ABSTRACT 



Linear programming has been used to maximize alloca- 
tion problems in many fields o This technique will be 
applied to the problem of planning research with optimal 
allocation of limited resources, A model is constructed 
with detailed information concerning necessary inputs and 
resultant outputs, amplified bv sample problems, A sensi- 
tivity analysis and interpretation of all results is 
included. The model has been constructed to be of primary 
interest to the Office of Naval Research but can be adjusted 
to the needs of other groups engaging in research. 
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INTRODUCTION 



In recent years, the increased ernnhasis on research and 
development, by both private and governmental organizations, 
has raised the questions "Can research be olanned?" and "If 
so, can it be planned optimally?" This reoort concerns the 
second question, the problem of the optimal allocation of 
funds for the accomolishment of a research objective^ The 
technique oroposed in this thesis to answer the second 
question is linear program.ming « 

Linear orogramming was first suggested as a technique 
to explore the area of research planning by Dro Fred Rigby 
of the Office of Naval Research* His paper "Activity Analysis 
of Research Planning in ONR" , written in 1963, proposed the 
feasibility of constructing a model predicated on the re- 
search effort of ONR and utilizing linear programming* 

Prior to the paper bv Dr* Rigby, the Office of Naval 
Research had completed a study of research planning which 
was called the "Ad Hoc Research Planning Committee Report*" 
This study effort was headed bv Captain J* F* Gustaferro, 

USN. An outgrowth of the study was a report bv Herman I* 
Shaller, also a member of the Ad Hoc Comm.ittee; his report 
is titled "An Exploratory Study in Research Planning Method- 
ology" c 
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This thesis utilizes the information in the above 
reports and is an attempt to implement the suf^gestion made 
by Dr. Rigby to utilize linear programming for the investi- 
gation of research planning. 

For the purpose of the thesis, an organization diagram 
of ONR, Appendix 4, has been simplified into the following 
form: 



REgPARCH HEAD 



Branch Heads ^ le Id 1 J F i e 1 d'^ ]F £ e Id Sf 

pate gory ~l[ ^Categor^]^ pa te go~ry 2J 
Category ^ pa'tegory 2| pat ego py 2f 
A total budget is received by the research head, and 
is passed on to the department or branch heads. These 
individuals, each heading a particular scientific field, 
such as biology or physics, must then decide how to allocate 
available funds .among the various activities comprising 
their particular departments. The smallest sub-division 
of a particular department engaging in research is called 
a category. Examples of categories in the Electronics 
Department of ONR may be found in Appendix 3, page (yZ. )o 
This thesis assumes that the department heads will divide 
the total budget among the categories rather than by making 
an initial allocation to the departments. The problem, 




therefore, is that of dividinp the hvjdset among the categories 
to maximize the research effort. 

To maximize the research effort of the organization, the 

particular mission of that organization must be examined, 

1 

The mission of ONR is: 

to encourage, promote, plan, initiate, and coordinate 
naval research to orovide for the m.aintenance of future 
naval power and the oreservation of national security; 
to conduct naval research in augmentation of and in 
conjunction with research and development conducted 
by the respective bureaus and other agencies and 
officers of the Department of the Navv; to supervise, 
administer and control all activities within or on 
behalf of the Department of the Navy relating to 
patents, inventions, trademarks, copyrights, royalty 
pavments and matters connected therewith; to represent 
the Department of the Navy in dealings of Mavy-wide 
interest on research matters with other governmient 
agencies, corporations, educational and scientific 
institutions, and other organizations and individuals 
concerned with scientific research; to survey the 
world~v;ide findings, trends, potentialities and 
achievements in research and development, keep the 
ASM (R and D) and the Chief of Naval Operations ad- 
vised thereon, and disseminate such inform, ation as 
aopropriate to interested bureas and offices v/ithin 
the Department of the Navy, and to other Governmiental 
or orivate agencieso 

Cor' -t-v-a Duroose -t-V’o linear nrogramming miodel - t-his 
mission must be described by a oarticular distinct set of 
objectiv^es which must be internally independent o ONR calls 
these objectives attributes » Clearly the missio’ of an 
organization may be described by more than one set of attri- 
butes or objectives. Each oarticular set of attributes 



^Office of Naval Research Organizatioi Manual, ONR 
Inst. 5420. IE, Aug. 1961 
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which describe the mission is called a clas s ification sys tem. 
Examples of attributes in a classification system might be 
scientific value, military value, and technological value o 
Examples of other classification systems used in the Navy 
are shown in Appendix 3, page (73 ). Therefore, attributes 
are organizational objectives. 

Inter-relations and dependencies exist betv/een Navy 
bureaus and the research activity of ONR, An example of 
such a situation may be described in this manner; Assume 
that scientific value, military value, and technological 
value comprise one classification system, and that anti- 
submarine warfare, air warfare, and surface warfare are 
another, both describing ONR's research effort. Increased 
research activit' in underwater sound transmission will not 
only affect the military attribute of the first classifi- 
cation system, but the anti-submarine warfare attribute 
of the second classification system as well. The model is 
developed to recognize these interdependencies and still 
achieve an optimal resource allocation with consideration 
given to other classification systems. Therefore, category 
suDDort in one system will affect results in other classi- 
fication systems. 

To apply linear programming techniques to the problem 
of research optimization involved translating the following 
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linear programming concepts: maximize c^X subject to con- 

straint equations AX > b and X>0, where A denotes the 
technology matrix, b denotes the requirement vector, c"^ 
denotes the cost coefficients and X denotes the unknowns c 

Symbology and definitions used in the above trans- 
slation were originally formulated by H. Shaller [4]<, His 
paper outlined a method of displaying an existing research 
program in matrix form. This report attempts to find a 
method of maximizing the results of a research program as 
well as finding the most effective way to change the program 
when new conditions arise. 

In the proposed model, the unknowns to be determined 
are the amounts of funds to be assigned to a category to 
optimize program effectiveness. These unknowns are denoted 
by X. c"^ denotes a set of coefficients reporting the effec- 
tiveness of a category to the mission of an organization per 
research dollar invested in that category. The term 
category e f fectiveness refers to the amount of progress 
made in achieving the mission of the organization per dollar 
input to that category. Therefore, c"^X is the objective 
function to be maximized. 

To utilize the experience of the research manager, 
constraint equations are formulated so that the require- 
ments vector b is composed of the set of all category 
funding levels. Each category has two fuiding levels. 
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These funding levels are the lower and upper bounds on the 
amount of funds the research manager desires to spend for a 
oarticular category. A lower funding level may be computed 
by determining the minimum amount of funds a category must 
receive if any research is to be accomplished^ An upoer 
funding level can be chosen from a history of past funding 
to a particular category or by the research manager 
evaluating a category's ootential contribution to his 
mission. 

Because of formulating the constraint equations in this 
manner, each element of the technology matrix A takes on a 
value, -1, 1, or 0. Therefore, the objective function is 
maximized by selecting levels of category funding between 
a lower and upper funding level previouslv determined by the 
research manager. Further exolanation and examoles of 
these concepts are found in the sections titled Model Inputs, 
page ( 13 ) . 

The questions to be examined in this thesis were 
originally discussed by the author with personnel of ONR 
during a summer assignment there in 1963 ^ 

These questions were also posed in the Ad Hoc repor 
oreviously completed. They are; 

1, What is the effect of a budget alteration on the 
present research program? Can all categories continue to be 
supported? What activities must be curtailed or reduced. 
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and by how much, to achieve optimum program effectiveness 
within this new budget? 

2 6 If a new category is added to the research program, 
how must I modify the existing program. What is the optimal 
way for this change to be accomplished? 

3. What is the effect of a change of emohasis on the 
program? Hov; should a reallocation of funds to accommodate 
this change of emphasis be made? 

These questions are not necessarily exhaustive. New 
questions may occur to the reader v;hich can be answered 
by aoplying the linear nrogramming technique. 

To answer these questions six oroblems were arbitrarily 
developed. These problems were solved with the aid of the 
CDC 1604 computer of the Naval Postgraduate School, Monterey, 
California. Because of the tedium involved in applying the 
linear programming technique to a large problem and the 
difficulty in inverting large matrices, computers are 
essential in applying this method. Because computers must 
be used in the solution of the problem, care must be exer= 
cised to insure that the size of the problem formulated 
does not become insolvable due to limitations of existing 
computers. The problems would be unmanageable if too many 
constraint equations were formulated due to a large number 
of categories in use. Grouping of categories might then 
be necessary. 
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The data used in the sample oroblems of the thesis 
are arbitrary and have no particular significance » The 
first two problems are maximizations of a program's 
effectiveness when two different classification systems, 
identified as A and B are used to identify the same research 
programs The results of these problems indicate the 
allocation of funds which optimize program effectiveness. 
Problem three combines the A and B system by arbitrarily 
adding their objective functions^ The results are not of 
great interest unless a research organization can operate 
in this manner. Problem four examines the effect of per- 
turbing the requirements vector. Problem five, the most 
interesting, and perhaps most useful, examines the effect 
of ODtimizing the research effort of a particular classifi- 
cation system when subject to the constraining influence of 
another classification system. This problem approaches 
realism to a greater degree than do problems one and two. 
Problem six explores the effects of a budget cut on the 
research program, A sensitivity analysis is conducted on 
problem one to evaluate the sensitivity of the solution 
obtained with respect to variations in the input parameters. 
Detailed results were obtained for all six problems. From 
these results the following general conclusions can be 
drawn: 
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Is The linear DrogramminR model can be of great 

assistance in planning a research orogram oroviding 
a means of evaluating the reliability of the incut 
data existss 

2» To assist in formulating the input data, further 
study is recommended into the problem of quanti- 
tativelv measuring the outout of a research orogram. 



9 



•* #Q rtrr. t4H>pe» P^riJT 

« 

■r-isvi mfii ff-: I !u.l' ' *1? t ,e«* -i»v# ‘t« JWl* 

it's*’*! tjjN^ni •/(» HI fwitan oT 

1^ I/- mi^fr .1 %.if ou i ti vt»aJi 

.•■ft i r 1 '■ --•'T *c .v'‘. » iT'l.T nr Hiimnw 'U'taviJiriT 






f’' 




4 



m Jir? 






ASSUMPTIONS 



Primary Assumptions 

For model construction purposes, it is assumed that the 
total research domain can be divided into subdomains of 
manageable size, that is, the number of categories does not 
result i'n too many equations for solution by nresent com- 
puter techniques. Homogeneity in the branches and 
categories must exist in order to establish independence 
among the linea" equations to be form,ed. Homogeneity can 
be aoproxinated through proper category definition „ For 
our m.odel, homogeneity and manageability of the branches 
and categories are assumed to be present o 

The program managers, through judicious application 
of management techniques, achieve within-activity ootimi- 
zation. This implies that for a given resource inout 
to a category, the research manager will so use his resources 
that the quantity and quality of research output is opti- 
mized. A graph of the relationship between resource 
input and research output ^ follows; 



^Rigbv, F. D. Activity Analysis of Research Planning 
in ONR, 1963. 

^Ad Hoc Research Planning Committee at the Office of 
Naval Research, 
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Uoper threshold point 



Research output 



/ 




Resource Input 



Graph 1 

The lower portion of the curve exemplifies that situa- 
tion where a research project has just begun. In this range, 
outout in relation to input is low. Possible reasons for 
this may be that the group has not "jelled," proper equip- 
ment is not vet on hand, or the problems themselves are not 
completely formulated. The major nortion of the curve is 
aoproximately linear with an unknov;n slope . Here, the 
assumption is made that a large number of workers adequately 
financed v;ill progress in a linear manner toward solution of 
a problem. Research teams are now organized, goals have 
been set, and all the inputs are now present for problem 
resolution. This area is the most prevalent one in today’s 
research organizations. The upper portion of the curve 
constitutes a region of diminishing returns for resource 
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inout. Such a condition may occur when severe scientific 
roadblocks, requiring a major breakthrough to clear, are 
oresent. An example of such a situation might be the 
oroblem of finding a light but effective shielding for 
nuclear reactors to be used in automotive transDortation » 

A region of diminishing returns might also occur if 
adequate exnerimental equipment or sufficient new scientific 
personnel were not available. 

Tvjo Doints of interest, therefore, are the lower and 
uooer activity thresholds. An ability to estimate the 
lower threshold point would enable the research manager 
to evaluate when a large output return would be imminent 
for small resource input. Knowledge of the upper threshold 
point would enable him to partially shift his resources to 
another category when diminishing output was impending. 

An evaluation of these threshold points v;ill not be 
attempted in this report. 

Studies are presently being conducted to examine the 
feasibility of measuring research output. As yet no such 
measuring device for ONR has been found, thereby necessi- 
tating another major assumption. The efficiency of a 
particular category with respect to an attribute is a 
necessary model input. This efficiency is defined as 
research output divided by resource input. The sum of a 
categorv’s efficiency to all the attributes must equal one. 
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Consequently, estimates of category efficiency are entirely 
subiective. Therefore, we must assume that experience will 
enable the project manager to make a reasonable estimation 
of this quantity. This subjective estimation is a model 
weakness . 

Secondary Assumptions 

It is logical to assume that a certain level of resource 
input per category is essential if a meaningful amount of 
research is to result. The minimum amount of financial 
support a category must receive if progress is exoected 
must therefore be established. It is assumed that meaning- 
ful research can be accomplished with a minimum of one 
unit of research ^ where a unit of research is defined 
as the research input necessary to support the average 
research scientist for a given time interval. For model 
purposes, the time interval will be one year. A necessary 
lower bound on category financing, therefore, is the cost 
of maintaining one unit of research in a particular category. 

The determination of what constitutes a "research 
scientist" and the evaluation of his work is entirely 
subjective. Junior researchers may be weighted less 

^Shaller, H. I. An Exploratory Study in Research 
Planning Methodology, ONR Report ACR/NAR-27, Sept. 1963. 
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heavily than senior researchers. Greater emphasis may be 
placed upon the work of a particularly outstanding individual. 
By apnropriate adjustment, therefore, the unit of research 
will be used as the least common denominator for all quanti- 
tative arguments. 

For purposes of simplicity, the proposed mode] will 
not include those conditions where financing is done over 
a period greater than one year. If these constraints are 
desired for practical application purposes, they may be 
formed as yearly ratios and included in the < rray of 
constraint equations. 
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CONSTRAINTS 
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CONSTRAINTS 



Optimization of the research effort is defined as that 
set of resource allocations which achieves the greatest 
effectiveness under a given set of constraining conditions^ 
Constraining conditions are essentially those bounding factors 
which the research manager desires to be considered in the 
overall solution to his oroblem. The restrictions to be dis- 
cussed are budget constraints, balance constraints, and 
threshold constraints. 

Budget constraints consist of those limits superim- 
posed on the research program by monetary considerations. 

These budgetary allocations may be presented in a number of 
forms; as a single ceiling under which the research manager 
must conduct his entire orogram; as a series of budget 
ceilings placed on individual branches or categories. In 
the former case, there exists essentially one bound, while 
the latter example contains constraints equaling the 
number of categories individually budgeted. 

A threshold constraint might be defined as the minimum 
resource allocation to a category necessary to conduct 
meaningful research. It has been previously assumed that 
meaningful research can be accomplished with a minimum of 
one research unit, therefore the threshold constraint uer 
category is the cost of maintaining a research i nit in a 
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Darticular category. The expression "meaningful 
is subiective. As there does not exist a measur 
for research output, the "one unit of research" 
was chosen essentially by experience. Therefore 
criteria for "meaningful research" can be chosen 



research" 
ing device 
criter ia 
, the cost 
arbitrarily. 
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MODEL INPUTS 



Five items will be discussed as inputs to the model, 
of which tv;o are constants, two are subjective variables, 
and one is a subjective constant. 

CONSTANTS 

A total and fixed budget over a vearly interval must 
be soecified. This budget may later be influenced by the 
conclusions drawn from model results, but a fixed amount 
of dollars for research ourposes must initiallv be deter- 
mined, The total budget for ONR is determined within the 
Defense Deoartment. X will denote the total budget. 

As oreviously noted, a unit of research is defined 
as the resource incut necessary to suoport the average 
research scientist for one year. The cost of a unit of 
research will naturally vary widely. among different 
categories, depending uoon the area of investigation. 

A research scientist engaged in subatomic oarticle study 
might require the use of highly sophisticated equipment 
while a mathematician investigating a theorem might need 
only nencil and paper. Cost cer research unit in a oarti- 
cular categorv might also include such items as floor soace, 
supporting personnel, salaries, and overhead. The total 
cost per research unit in the ith category will ; e denoted 
bv K(C.). 
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SUBJECTIVE VARIABLES 



The overall mission of an organization is clearly soeci- 
fied in terms of such attributes as maximization of orofits, 
maximization of military might, or maximization of research 
progress. After breaking down a specific organizational 
mission into its attributes, a decisior must be made as to 
what emohasis is to be placed on each attribute. The 
emphasis factors will be in percentage form, with their 
sum equal to one hundred percent. The decision as to what 
contribution an attribute is to make to the overall mission 
will originate from the upper levels of an organization. 

The direction a research organization will take is now 
determined. C(A^) will denote the contribution of the 
j^^attribute to the overall mission. 

Another model input is the approximate emphasis that 
is to be placed on each category. This factor may be 
determined from study of the history of the organization, 
from an estimate of the importance of a particular category 
to the overall mission, or from empirical observation. 

This decision v;ould usually be made at a lower organiza- 
tional level--in ONR by the department heads. These 
estimates are to be assigned in bracket form. For example, 

10 to 15 percent might be assigned to category one, and 
30 to 40 percent to category two. Care must be taken to 
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insure that the sum of the lower estimates is less than 100 
oercent and the upper estimates sum to greater than 100 
percent. WCC^) will denote emphasis to be placed on the 
category. 



SUBJECTIVE CONSTANT 

The efficiency or progress a category contributes to 
an attribute has previously been discussed in the section 
titled ASSUMPTIONS . The project manager must decide what 
contribution his category makes to a particular attribute. 

The sum of these percentages must equal one hundred. The 
degree of difficulty in making such a decision will naturally 
vary with each category, A category such as propaganda 
obviously has a large preponderance of military rather 
than scientific value. A project manager concerned with the 
oropaganda category may decide therefore that 15 percent 
of this category contributes to attribute one, 60 percent 
to attribute two, and 25 percent to attribute three. It is 
recognized that this subjective estimate may at times be 
very difficult to make. Progress contributed by the ith 
category to the jth attribute will be denoted by P,^ 
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MODEL INPUTS 



1 , X •• total budget 

2. C(Aj) - Contribution of the attribute to the overall 

mission . 



3. WCC^) - Emphasis placed on the i^^ category 

. • "th 

4. - Progress contributed by the i category relative 

to the jth attribute per dollar. 

5. KCC^) - Total cost per unit of research in the i"^^ 

category , 

K(C^) is expressed as: 

K(C,)= a.z.* bjV.t c.w.t d.y.... 

vjhere : 



1. 


'’i 


= 


cost 










scientist year 


2. 
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of research 
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cost 
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of personnel 
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9. Scientist year -- unit of research 
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MODEL OUTPUTS 
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MODEL OUTPUTS 



Direct Output 

After consideration of the inputs previously discussed, 
the model indicates the amount of resources to be allocated 
to each category. • The resource allocation to the i’’-^ category 
will be noted Xj . 

Computed Output 

Upon arriving at a set of optimal resource allocations, 
certain additional quantities may be of interest. These 
values will be displayed in matrix arrays as formulated by 
H. Shaller in ^ Explorator y Study in Research Planning 
Methodology . [4] 



COMPUTED M ODEL OUTPUTS 

1. ■ Number of research units in the i*^ category. 

2. u^. - research units in the i^^ category 

corresponding to the j'th attribute. 

3. = Effectiveness of the i"^^ category relative 

^ to the attribute to the overall ;..ission. 

4. E^g = Effectiveness of the i^^‘ category relative to 

all the attributes per research unit. 

5. E{ r Effectiveness of the i^^ category relative to 

all the attributes per research unit. 

5. E = Total effectiveness of the research program. 

7. E ( ) =Emphasis resulting on the goal of the B 

classification svstem. 
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NOTATION 



1. 




= The i^^ category. 




2. 


^3 


= The attribute. 




3. 


C(A.) 


= Contribution of the 
mission . 


attribute to the overall 


4. 




= Resource allocation 


to the i"^^ category. 



5. 

6 . 

7. 

8 . 

9. 

10 . 

11 . 

12 . 

13. 

14. 

15. 

16. 



X 



K(Ci) 



U : 



U 



13 



V 



Pij 






^la 

E 

W(C. 



El 



= Total resources. 

= Cost per research unit in the i^^ category. 

= Number of research units in the i'th category. 

= Number of research units in the i"*^^ category 
corresponding the the attribute, 

= Total number of research units accomplished. 

= Progress contributed by the i"*^^ category 
relative to the attribute per dollar 

= Effectiveness of the i^^ category relative to the 
attribute, 

= Effectiveness of the i^^ category relative to all 
the attributes. 



) = 



E(Bj) = 
i = (1, 



Total effectiveness of the research program. 

Emphasis placed on the i*^^ category. 

Effectiveness of the i"*-^ category relative to 
all the attributes per research unit. 

Emphasis resulting on the j’’-^ goal. 

2j ..«.m}^ ^ “ Clf 2^ ....n) 
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MATHEMATICAL DEFINITIONS AND BASIC EQUATIONS 



1. :^C(A-.) = 1 

» J 

2. 2LW(C.)=1 

3. ^D-r =1 



MODEL INPUT 



1 . 

2 . 



5 x.=X 

L^l 1 



Ui = 



KTCji ) 



MODEL OUTPUT 



3. 

4. 

5. 

6. 

7. 

8 . 



" P^y ^ ^ 
=jfr ^ 

— w\ 

E= .2 E 

E(l3,)=2\Jq- 

J t5 I ^ 



13 

Z. ULC 

t-=* 



^cj = 



RESTRAINTS 



DEFINITIONS 
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SAMPLE PROBLEMS 
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SAMPLE PROBLEMS 



A Brief Description 

Six samDle problems have been constructed to evaluate 
the model. The data used are arbitrarily collected and have 
no particular significance. Problems one and tv/o are maxi- 
mizations of different classification systems (called A and B) 
and describe identical research orograms. These two classi- 
fication systems are initially considered to be independent 
of one another. Their interdependence is examined in problem 
five. Problem three experimentallv combines the A and B 
systems by arbitrarily adding their functional equations. 
Problem four examines the effect of varying the range width 
of the W(Cj^)s on the outcome of problem three. Problem five 
treats the B classification as an additional constraint 
equation of oroblem one, and maximizes this new problem. 
Problem six examines the effect of a budget reduction on 
the optimum allocation of resources to the categories. To 
evaluate the sensitivity of the solution, a sensitivity 
analysis was conducted on the input parameters of problem 
one. All problems were solved with the aid of a CDCI604 
Computer. A discussion of the results of all problems is con- 
tained in the conclusions. 
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General Discussion for Problems One and Two 



Problems one and two maximize the effectiveness of the 
identical research program by means of two assumed independent 
classification systems (called A and B), The data used in 
both oroblems were arbitrarily collected and are without 
Darticular significance. The interrelationship between 
these two problems is treated in problem five. 

Objective functions and constraint equations are 
developed for both problems and solutions are then obtained 
by using linear programming techniques. An investigation 
for alternate solutions, and a sensitivity analysis is 
conducted on problem one. 

The model inputs nreviously discussed will now be 
tabulated in matrix format as developed bv H, Shaller [5] is s 



C(. C(A2). , . .C(An) 



K(C;^) 


'HCi) 


°11 Pl2 P].n 


K(C2> 


vnc^) 


^21 P22 


* 


• 


0 


0 


» 


« 

• 0 


K(C^ 




PpiL Pm2 • Pflin 



Table 1. Data display using a matrix format 
where X = total budget 
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Problem one Maximization of the A clrassi f ication system 




For this 
problem 
arbitrarily 
take 

X= 895,300 
dol iars , 

For simoli= 
city k(C;) 
has been 
chosen a con- 
stant 
of forty 
thousand 
dollars , 



Obiective Function 



The total effectiveness of the research prcp.ram is 

definted to be: ^ ^ 

=2.«-iC.'= 2 2. =,§. 2- Pi- C(Aj)u.i 

I >'-1 J ' J 

For Problem one, therefore, the objective function to be 
maximized is: 

E = X ( ‘ 399x,+.240 x^ + .262 x^+ ,471 x^+ ,521 x^+,311 x^ 

^ HO >. 

t ,\H5 Xy t ,23V Xg + -37.2 t .37-2 j 

where the coefficient for x, is determined from the 

relationship 



4 



p-.C(Aj) 
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Accordingly i 



(.l)(.130)+(.7)(.521)+(a)(.194)+(.l)(.020)=„399 

Constraint E quation Format 

The constraint equations ax'e determined from the 
data^ Also 

7<- = W CC'JA 

lO 

where .-21 x = 895.3 thousand dollars 

L= I *• 

Accordingly ; 

Cj; X| (in thousands of dollars) 

1 5 3.7 i X, i 80.6 

2 116.3 fX2^i39.9 

V 

3 21.5 i-X 3 ^48.4 

4 8.9 10.8 ^ 

5 57. 54 X 5 4 75. 5 r 

6 118.2 4 - 322. 3 - 

7 10. 8 4 X,4 10.8 

8 8 9.5 4 Xg4 96.7 

9 214.9 4>^4304.4 

1 0 69.5 4-X,^im.6 



the objective function developed for orobiem one can nov/ 
be maximized subject to the above linear constraint equations 
by standard l-'near programming techniques. 
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Results of Problem one 



Table 3 displays various quantities that may be of 
interest to the research manager,, Column one indicates 
the support a category should receive for maximum effective- 
ness in the research orogram. The total number of research 
units contributed by the itl^ category to the program, lj£ , 
is obtained by dividing Xj_ by the cost of a research unit 
of the i’^^ category, K(C^). may be broken down into the 

number of research units which correspond to a particular 
attribute by the relationship: 



Therefore : 



i 


Xi 


Ui 




A 2 


"^3 




^5 




"i 

-I. 


80.6 


2.02 


.20 


i .41 


.20 


0.0 


0.0 


.20 


2 


116.3 


2.91 


.29 


. 87 


87 


.29 


.29 


.29 


3 


21.5 


. 5 4 


.11 


.16 


.23 


0.00 


0.00 


.05 


4 


10.8 


.2 7 


0.0 0 


.25 


0.00 


0.00 


0.00 


.02 


5 


75 . 5 


L 89 


0.0 0 


1.89 


0.00 


0.00 


0.00 


o 

o 

o 


6 


118.2 


2 . 96 


.59 


L 48 


.29 


0.00 


.30 


.29 


7 


10.8 


.2 7 


.13 


.03 


.03 


o 

o 

o 


.05 


.03 


8 


89.5 


2.2 4 


.45 


.67 


.45 


.22 


.22 


.23 


9 


282.6 


7.07 


.71 


4.24 


1.41 


.71 


0.00 


0.00 


10 


89.5 


2.24 


.22 


1.24 


L 45 


.22 


0.00 


0.00 



Table 3 - The u^^ array distribution of units of research 
versus' dollar input. 
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Three other quantities may be of interest to the 
research manager* They are; 



a. 






b. Ei 



^ia 



Therefore t 



- Effectiveness of the i^^ category relative 
to the attribute and is defined by 

~ Ptj ^ 

= Effectiveness of the i^^ category relative 
to all the attributes per research unit and 
is defined by 

^ E Ij 

= Effectiveness of the i^^ category relative 
to all the attributes and is defined by 



c 


rrz 


A2 


A3 


A4 


A 5 


A6 


r ! 

i ' 


Eia 


1 


.013 


. 364 


.019 


.000 


.000 


,002 


.399 


, 806 


2 


.013 


,15 6 


,058 


,0 0 7 


.003 


,002 


,240 


.977 


3 


,026 


,156 


.077 


.000 


.000 


.002 


,262 


.141 


4 


,000 


.46 8 


.000 


.0 00 


.000 


,00 2 


,471 


,127 


5 


.000 


.5 21 


.000 


.000 


,000 


.000 


.521 


,985 


6 


. 026 


,260 


.019 


.000 


,00 3 


.002 


.311 


.921 


7 


. 065 


.052 


,019 


,000 


.006 


.002 


<14 5 


,0 39 


8 


, 026 


.15 


.038 


,007 


,003 


,002 


.233 


.523 


9 


, 013 


. 311 


.038 


.007 


,000 


.000 


, 372 


2,628 


10 


.013 


,312 1 


1 .0 38 


,007 


.000 


,000 


,372 


,832 



Table 4. The effectiveness array versus categories 
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I 



IV 

Total system effectiveness 7,j7 units 

|,r 1 

This method of disolavins^ data* (Ho oraller l4j) indi- 
cates how mach a category contributes to a oarticular 
attribute 0 Thus category four has the greatest contri- 
bution to attribute tv;o. An increase in emphasis on 
Attribute two mav oossibly be acccmDlished by increased 
suooort to category fouro 

Alternate Solution to P ro y. e m on e <, 

An alternate solution » determined bv stanciai'd Linear 
orogramming techniques, was found to exist for oroblem onoo 



Solution I 


Solution II 1 


General Solution 


Xi 


80 o 6 


8C.6 


80.6 


X2 


116o3 


110,3 


116.3 


^3 


?lo b 


21 ob 


21.5 










X.. 


lOo 8 


10,8 


10,8 












/bob 


75,5 


75,5 




118„ 2 


118,2 


118,2 


i 


10,8 


10,8 


10,8 


00 


89,5 


89,5 


8 9,5 




282o6 


257,5 


(282, 6-25, Ik) 

; ( Oikfl 


X 

O 


89cb 


114,6 


( 89 ,5+25, Ik) 



Table bo Categorv allocations which maximize 
nroblem one o 

IS 



As two solutions exist to problem one , any convex 
combination of these solutions will maximize this problem, 
as ^iven under column headinp, of General Solution. 



Sensitivity Analysis of Problem One; 



A sensitivity analysis was conducted on problem one 
to determine the extent of dependence of the solution upon 
the input parameters. Standard Linear programming proced- 
ures were used to determine this dependence. The results 
are as follows; 

A, Sensitivity of the coefficients in the objective function . 
After completing the linear programming procedures, it 
was found that the following relationship among the co- 
efficients must exist if an optimal solution is to be 
maintained. 

Equation 1 e' p* p' >p'> p' p' 

where : in the sample problem; 

, 399 



1 
/ 

2 
i 

3 - 

t 

A 



E, 



6 - 



311 



240 
, 260 
,4 71 



Ej = .521 



E^ = .145 
Ey = .235 
Eq = .372 



= .372 



Therefore the solut5.on is most sensitive to an increase 



in and 



■(> 



and to a decrease in E, . As E is defined 



as 
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Changes in the (A- ) can now be examined* As was oreviously 
noted under Model Inputs » the contribution an attribute is 
to make to the overall mission will originate from the 
upper levels of an organization. Changes, therefore, that 
do not affect equation one 111 not change the 

optimality of the solution prcv’iously attained. If 
equationlis no longer true, however, the oroblem must be 
re-run , 

To investigate the reliability of the solution, the 
research manager vjould be interested in noting the effect 
of varying the P^^s uoon the solution. An example of 
this is: 

Examole 




original = ,311 



new 

Consequently, ontim.ality is still maintained. 

As e/p = Eq increase 2 exoense of any 

othe^ D would clearly change the ootimal solution. 

10 , 1 , 
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B, Sensitivity of the VHC^)s 

Let W(Cj[) unoer bound be denoted by 
W(C|) lower bound be denoted by 
The optimal solution is maintained providing the 
follov;ing relationshio exists. 

Equation (2) X-bq^B^>C = bcj 

where B^b, + b^ + b +b_+bu+b- +b, +b_ +b = 612,7 

and where X = total budget = $895j300» 

In nroblem one this relationship is 

590,9 i 612,7 £ 680,4 

Therefore; a change in the WCC^) that leaves equation (2) 
unchanged will not affect the ootimality of the solution. 

Example 



original 'aq = 


214,9 


new loq = 


254,9 


III 


75,5 




95,5 




O 

o 

CO 


N = 


20,8 



Therefore B = 642,7 “ 640,4 

B is not less than X = ^ ^nd the problem 

must be rerun, 

'^roblem Tvjo 

Problem t'-?o is formulated so that the ''/(C^)s and the 
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A ccmcarison 



) (C^ )"s are the same as that of orobjem one>, 
of category emohasis between these two oroblems can then 
be madSo A new classification system is used which con- 
sists of three attributes instead of the seven used in 

oroblem one^ The o.-s and the CC5.)s will therefore not 

‘11 .1 

be identical to those used in the orevious probipnio The 
classification system used in problem ti'?o will be denoted 
as the B systemu 



The re f o re l DATA 



-g-C Bj ) 



i 


W(C ) 


0 363 


oSlO 


0 I 2 O 


1 


o060-a09C 


o25 


o55 


.2 


2 


aao-ase 


o4 


0 3 


0 3 


3 


„ 024- . 0S4 


0 


0 


0 


4 


. OlO-o 012 


0 


0 


0 


5 


o064-c 084 


0 


0 


0 


6 


. 132-0 360 


.,5 7 


o43 


0 


7 


0 OI 2 - 0 OI ? 


o5 


o5 


0 


8 


0 IOO-.IO 8 


■ oO 


0 


0 


4 


.,240-0 


0 

0 


0 B5 


oOS 


10 


1 ?R 


0 10 


0 85 


1 c 

1 

i 



X= «95„100 dolla-s 



K(C^) a iiO.OOO dollars 



Table 6o Inpi** da-^a to p’:'Cblem tv;c . 



function for oroblem tv^os 



Obicctiv 






B ■ ^ ^ Ptj 



=.J_ c 19Sxji o33'4x^+.'1?6 x^+ .437 x^+ ,.363^x +.477x<^ 
Ho 






Coefficients for ^ Xl^ ^ X 5 equal zero 
System of co ns traint equations for problem tvro „ 
Same as that of problem one. 



Results of Proble m two . 



The results of problem two are disolaved in tables 
seven and eight. Column one in table seven indicates the 
support d category shoulvd receive for maximum effectiveness 
in the research program,, using this particular classifi- 
cation system. Uj’ is again calculated from the definition: 






Columns four through six indicate the for the B 

classification system. Columns seven through twelve indicate 

the u ;4 values for the A classification svstem of problem 
1 -) - ■ 

one 4 using the X£ values of problem tvro. An example of 
the effect of using the Xj^ values of problem t'-;o on the 
A system is the decrease of from, .20 to .13 while ugx 

increased from .59 to .72. As expected,, changing the level 
of category support v;iil affect the amount a category 



contributes to a particular attribute and to the entire 
programs Table eight is computed in an identical manner 
to that of table three in problem oneo Columns one through 
three indicate the E^j of the B system^ Columns four and 
five display E£» and E^ respectively o Column six is the 
new E^g of the A system when using the category supports 
of the B systems An example of the change in Eia of the 
A system* is the decrease in E^^ from o 806 to 06680 



OPTIMIZA TI ON OF CLASSIFICATION SYSTEM 



i 


^i 


i 




l'-F2 


«3 






^‘3 


A4 






1 


lo 34 


53,7 


0 34 


,74 


,26 


,13 


,94 


.13 


0,00 


0,00 


,13 


2 


2,91 


116,3 


1,16 


, 872 


,87 3 


,29 


,87 


,87 


,29 


.29 


,29 


3 


0 5 4 


21,5 


0,00 


0,00 


0,00 


,11 


,16 


,23 


0,00 


0,00 


,05 


4 


0 23 


8,9 


0,00 


0,00 


0,00 


0,00 


,21 


0,00 


0.00 


0,00 


.02 


5 


1 ,4 4 


57,5 


0,00 


0,00 


0,00 


0 

0 

0 

0 


2,44 


0,00 


0,00 


0,00 


0,00 


6 


3o 58 


143,2 


2.04 


1,54 


0,00 


,72 


L79 


.36 


0,00 


.36 


. 36 


7 


,27 


10,8 


,13 


,14 


0.00 


,13 


,03 


.03 


0.00 


,05 


,03 


8 


2,24 


89,5 


2, 24 


0,00 


0,00 


,45 


, 67 


0 4 5 


,22 


,22 


,23 


9 


7,61 


304,4 


,76 


5,07 


,38 


,76 


4,5 7 


1,52 


, 76 


0,0c 


0,00 


10 


2,24 


89,5 


,76 


1,90 


,11 


,22 


L34 

[ 


,45 


.22 


0.00 


0.00 



0 The arrays distribution of units of research 

versus' dollar input 



Table 7 



(10 



A svsterr E 



1 




^’2 


'a 


“ T ’ 


"ia 


1 


ao8 


.255 


.024 


.395 


.529 


9 


.145 


.153 


,035 


,334 


.972 


3 


0.00 


o 

o 

o 

o 


0.00 


0.00 


0.00 


1 + 


0.00 


0.00 


0.00 


0,0 0 


0,00 


5 


o 

o 

o 

o 


0.00 


0,00 


o 

c 

o 

o 


0.00 


6 


,206 


.219 


o 

o 

o 

o 


.*‘26 


1.525 


7 


.181 


.255 


0.00 


.4 37 


ai7 


g 


.36 3 


OoOO 


0.00 


, 353 


, 813 


9 


.036 


.434 


.006 


.476 


3.622 


10 


.0 36 


.434 


.006 


1 .476 


1.066 



la 



«5 34 
o 698 
«141 
„108 
.750 
1 .] 14 

.as 9 
„523 
2.830 
0 833 



Tota 1 
Effect- 
iveness 

E 



LCu 



’■ 8.6>2.wk\i+s 



Nev / E.= 7 . 5 ’ 7 L >^^|■^^> 

A 



Table 8. The effectiveness matrix versus categories. 



Table 9 indicates the results of aonlying the optimum 
set of category supoorts obtained in the A system of oroblera 
one to the B system of problem two. Using the of 

problerr- one therefore, we obtains 
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i 


X 


-5?- 










^3 


^i 


E- IB) 

1 <■ 


1 


80„6 


.51 


1.11 


.40 


.108 


.255 


.024 


. 395 


, 798 


2 


116,3 


1.16 


1 07 


1 07 


.145 


.153 


.036 


.334 


.972 


3 


21,5 


0.00 


0 0 j 


0 . 0 u 


O.C 


0,00 


0.00 


0.00 


.00 


4 


10 0 8 


0.00 


0.0 0 


0.0 0 


0,00 


0,00 


0,00 


0.00 


0.00 


5 


75,5 


0.00 


0.0 0 


0 . oo 


0.00 


0.00 


0.00 


0.00 


0.00 


6 


118.2 


1.68 


1.28 


0.0 0 


.206 


.219 


0,00 


.426 


1.262 


7 


10.8 


.13 


.14 


0,00 


j .3 81 


.255 


0.00 


.437 


.118 


8 


89.5 


2.24 


O 

o 

o 

o 


0.00 


. 363 


0.00 


0,00 


. 36 


.813 


9 


282.6 


.71 


6.01 


.35 


.036 


.4 34 


.060 


.476 


3.365 


10 


89.5 


. 22 


1.90 


. 11 


.036 


.434 


.060 


.476 


1,065 



Table 9 , Application of the optimum set of category 

supports obtained in the A system of nro). em 
one to the B system of problem two<, 



£ 1 - S- 39 un it's 



U2 




Graph 2o Dollar input Catogorys A comparison of 
the results of the A and 3 classification 
systems in problem one and two respect! ve ly <> 



A ' classification 
^ system (ontimized) 

B - classification 
° system (optimized) 



4 3 



Problem ITT 



The A and B classification systems were combined by 
arbitrarily adding the like components of their functional 
equations to determine the relationship » if any, between 
this problem and problems one and two» The resulting problem 
was to maximize the equations 

»748xj + o574 x^ + o 262 x^ + » 471Xi^ + » 521 ^ 5 -''’ x^+o581 x^ 

+ c59 7 Xg+ ,,849 x<^+ »849 x,q 
R esults of Problem III 



k£ = 40,0 for all x 

u^ = Number of research units in 
the i^^ category 

Total ef fectiveness s 16„23 units. 



Table 10, Results of problem three, maximization of 

function determined by summing corresnonding 
components of A and B classification systems. 



^1 


53,7 


1,34 


X2 


116,3 


4,07 


^3 


21,5 


,54 


X4 


8,9 


.23 


^5 


57,5 


1,44 


x^ 

0 


118,2 


2,96 


X? 


10,8 


,27 


^8 


89,5 


2,24 




30 4,4 


7,61 


^10 


114,5 


2,86 



Dollar Input 



Classification Systems 





Low 


High 


A 


B 


A+B 


^1 


53« 7 


80.6 


H 


L 


L 


CM 


116., 3 


139.9 


L 


L 


L 


^3 


21«5 


48.4 


L 


L 


L 


X 4 


8.9 


10.8 


H 


L 


L 


^5 


57.5 


75.5 


H 


L 


L 


^6 


118.2 


322.3 


L 


143.2 


L 


X? 


10.8 


10.8 


S 


S 


S 




89.5 


96,7 


L 


L 


L 




214.9 


304.4 


282 . 


6 


H 


H 


’^lO 


89.5 


114.5 


L 


L 


H 



S “ same 
H - high 
L = low 

From the results indicated 
indicated in table 8 ^ no 
particular relationshio can 
be discerned between problem 
three and problems one and twoo 



Table 11s A comparison of values which maximized 

effectiveness of the A* and A-« B classic 
cation systems = 



Problem 4 

In som.e instances a larger degree of uncertainty may 
exist on the part of the research m.anager concerning the 
range of separation between the lower and upper bounds 
of a category o Therefore j problem four uas run to note 
any effect on the results of problem three by initiaJlv 
choosing a wider range of category emphasis bounds 

Accordingly j the W(C^)s of problem three were varied 
by increasing the range between the lower and upper bounds 



45 




of each categorvo The lower and upper bounds were lowered 
and raised respectively by equal amounts for all categories o 
Maximization of problem three with respect to these new 
constraint equations was then performed » The bounds were 
varied in this manner four times, with the results indicated 
in table 12» 



46 



,n**'i'4 t ar tAm a*'i *;»»» .1 V’t Vl ai^iA‘t 

« 

nt*« •IsintfcC »itr ,t‘ -' Jt- r/ •! w J«ljprt.*rff 



<svyau»*lMw| art! 






tsirtj ,n Bwitt 
.^i sidAi 





1 




PROBLEM TV 
2 


3 




4 






LOV/ 


“TTiW 


LOW 


HIGH 


LOW 




TTJW 


inw~ 


1 


4 3.7 


?0". 6 “ 


3 3.7 


10 6.6 


~TT7T~ 


12 8.5 




146.6 


2 


106.3 


149.9 


96,3 


159,9 


76.3 


179.9 


56c 3 


199.9 


3 


11,6 


58.4 


0.0 


68.4 


0.0 


8 8.4 


0.0 


168.4 


4 


3.9 


21.8 


0.0 


31.8 


0.0 


51.8 


0.0 


71.8 


5 


4 7,5 


85.5 


3 7.5 
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Problem 5 



Since the research manager is usually confronted with a 
situation in which his categories simu? taneously emphasize 
attributes of different classification systems j the model 
is more realistic when classification systems are coupled,, 
Problem 5 v/as run to determine what relationship exists v;hen 
tv.»o classifica tion systems » A and B, of problems one 
and two* respectively, are combined c 

Therefore, a solution was obtained to the problem of 
maximizing the A classification systeirfs objective function 
using the object function of the B system as an additional 
constraint equation^ Values chosen for the B system function, 
X‘7hile acting as a constraint equation for the A system, 
ranged from its maximum value of 343 o 69 (obtained from 
problem to 3 3 2,0„ The lower value, 332 e0j was 

determined by evaluating the B system function with respect 
to those X values which had maximized the A system.o The 
results of problem five are displayed in table 13 and 
grarh 3 , 
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system constraint equations 



t 




ProhJen h 

Prohler. investigates the effects of a budget cut* 

a ttoblem soTiatimes encountered by the research nanagero 
After rr^aximininr nroblcm fivej part five* the total budget 
was cut from $395,300 to $825»300» The effects of the 
budget decrease on the optimal solution of the problem are 
displayed in table 14s Care was taken in choosing the new 
total budget, to remain above the sum of the lower budget 
limits of all categories. 

■’^‘ "^1 b u dget = $6 95,300 New bidget - $825 t300 

Xj; Valu es 

*"* ' Optimum category revised optimum 
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80 , 6) 
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139.9 
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1 3 R . 7 


3 2 2. 3 
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10 = 8 
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Q c 


96. 7 
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7 Vi . 9 
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3 0 , 
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89.5 


114.5 



Table 14. Comparison of results of category emphasis 
before and after budget cut. 
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CO MCLUSIOMS 

i.n the introduction, various questions were raised that 
were of interest to the research manaj’erj An exaTr'ination 
of the results of the six problems and the sensitivitv 
analysis enables us to answer these questionsc 

Results of problem one reveal several facts that are 
in agreement with intuition., After examination of the 
column, (page3M), emphasis would intuitively be placed on 
C5 , C4 , Cl, C9 , and the remaining categories in erner of 
their descending amounts ^ The intuitive allocation method 
would emphasize those categories which contributed the 
greatest amount to the research nrogram, per unit of re- 
searcho The upper values of these categories should always 
be chosen in descending order of their contribution until a 
point is reached in the allocation process that necessi- 
tates a shift to the lower bounds of the remaining categor- 
ies o This emphasis shift would, of course, be necessary 
in order for the program to remain within the total budget., 

The results of the linear programming technique on problem 
one v^?ere in agreement with those derived from the above 
intuitive considerations » 

Problem one has an alternate solution^ Hcv,/ever , this 
situation cannot always be expected.. An interpretation of 

this situation is that the research manager has an alternative 
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program he may follow and still achieve optimum results*, 

In this oroblem, resources have been shifted from C9 to 
CIO, resulting in maximum emphasis on this category*, 
Actually, any convex combination of these two solution 
sets would also be optimal « An alternate solution would 
also be advantageous in possibly increasing the effective^ 
ness of other classification systems** Thus, if greater 
emphasis is desired placed upon an attribute of another 
classification system no loss in program effectiveness need 
occurc A shift to the alternate solution might increase 
the emnhasis on this attribute while still maintaining 
the same maximum effectiveness as before » 

The reliability of any output is determined to a 
great extent by the sensitivity of the results on the 
input parameters*. In the sensitivity analysis conducted 
on problem one, the results (page 36) indicate that 
category nine is of major importance. Examination of these 
data indicates that the solution of the problem is most 
sensitive to changes in categories 10, 6, and 1, in that 
order, and fairly insensitive to changes in the other 
coefficients. With this information, emphasis changes 
in the C(A^ ) can now be analyzed*, 

As each cost coefficient is derived from the equation 
^ p.^j C CAj ) uncertainty in the exact value of pj^ j may 
affect the ordering relationship above and thus affect the 
solution. Assuming our values of are reliable, a change 
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in the C(Aj; ) that does not affect the orderinf’ relationship 
of the categories, will not change the existing programo 

Examining the analysis of the W(a)s, several interest- 
ing facts emerge 0 All categories except category nine have 
one bound that has no effect on the solutiono The lower 
bound on categorv one and the upper bound on category two 
are examples of thist Categorv nine is the exception j as 
is indicated by the results. If a shift in category 
emphasis is however desired, the quantity B is the indicator 
on how to proceed. Thus, if it is desired to place more 
emphasis on category one, two alternatives are available 
to maintain optimality. One alternative would be to still 
maintain the relationship X,“^- BiX - b^. 

The second alternative would be to shift resources among 
the variables of which B is a function. Thus, resources 
could be taken from category two, ov a combination of 
categories to accomplish this emphasis change. This in= 
formation would, of course, also assist the research 
manager in determining what values to perturb in investi- 
gation of other solutions. 

Problem tvjo also satisfies our intuition vrith respect 
to the E^ ' „ flere Eg* has the greatest value of all the 
categories. Once again, intuition would indicate that the 
greatest emphasis should be placed on category nine. After 
considering the total budget, a change of emphasis to the 
remaining category's lower bounds v;ould then take place „ 
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After solvinp the problem by linear programming techniques „ 
the solution was found to agree with that of the intuitive 
aoproach . 

Whether this method can be generally employed is a 
question for further inves ti gation o If the intuitive 
approach proves correct » linear programming techniques need 
not be used to maximize individual classification systems a 
As the intuitive approach was unsuccessful in predicating 
results for couoled classification systems as in problem 
five, linear programming techniques may be highly useful 
in these situations^ 

The maximization of the B system results in a loss cf 
(0o40) units of research as meastired in the A systemo A 
comparison of these two systems in graph two can be mis- 
leadings Graph two indicates that to change the emphasis 
from the A to the B system, categories 1, 5, 6, and 9 
should be nerturbeds This is not the case,- however, as 
nroblem 5 indicateso A problem also arises in finding 
the best position between these tx*70 extremes and determining 
the extent to which the categories should be re-emphasi zed o 
This information is also revealed in problem five^ 

The summing of the A and B system would be of interest 
if such a relationship had a particular meaning to a 
resea'^ch organi zation « It was done here for experimental 
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DurDOseSo As a new function was created bv this operation, 
it is reasonable to sunpose that the resulting set of 
x's vjhich maximize this problem could not be predictedc 
Such v;as the case^ 

Changes to the W(C£)’s were accomplished and the 
results are displayed in table 12 » These results are in 
accordance with theory in that no significant change in 
the X values chosen occurs c For categories 1, 3, 4, 5 
and 7, the lower bounds were eventually placed at zero to 
note anv effect upon the results » No change in category 
emphasis occurred « Placing a lower bound of a category 
at zero can assist the research manager in deciding whether 
to support a particular category. This situation may 
arise when a new category is to be added to an existing 
program or when a question of continuing support to a 
category is raised. If, for example , the set of W(C^) 
in Problem. 4, Part 4, had been chose/^ categories 3, 4, 5, 
and 7 would not have been supported while category one 
would have received support. 

In Problem 5, the A classification system was optimized 
with respect to the B classification system for various B 
values. This problem can aid the research manager in 
determining to what degree to vary a category and hot-j this 
variance will change effectiveness of a particular system. 
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Thus, a SDecific guide concerning the method of increasing 
emphasis on attributes of other classification systems is 
at hand ^ Table 13 would indicate the optimal manner by 
which resources should be allocated to accomplish thiSo A 
directive to increase emphasis on a particular attribute 
can novv’ be optimally accomplished using a specified category 
reemphasis » 

Graph 3, the maximum effectiveness comparisor between 
the A and B classif ication systems, is non-linearo 
Specifically, a loss of one unit of effectiveness from 307 
to 306 units in the A system results in a net gain to the 
B svstem of 4 7 units o A decrease of the A system from 
306 to 305 units results in a lovjer gain of 3»5 units^ 

A research manager might feel that a loss of two units in the 
A system ^^7as worth the increase of eight units in the B 
svstemo As this problem represents reality to a greater 
degree than do the others, it is the most importanto 

The point at which the A system equals 305 units is 
of interesto This ooint is the intersection between the two 
lines of slope 3.56 and 4„73o A point of changing slope 
on the graph may result due to the particular configuation 
of the objective function that is maxinizedo Further study 
is needed to explain this phenomenon „ 

Problem 6 reveals the results of a cut in the budget. 

The results indicate that all categories are olaced at their 
lower limit with the excention of category nine. This 
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of adjustment will not always be the case but vj-ill depend 
on the amount that the budget is cuto Category 9 received 
the remainder of the lunds available after all other 
categories had been suoported to their lower limit <, As 
Category 9 has the highest , this reapportining method 
is in agreement with intuitiono 

To evaluate the effect upon the system by the addition 
of a new category, the problem can be altered to fit these 
new conditions and the program re*rung 

In the hands of a skilled research manager, the 
Linear programming technique can be a valuable aido By 
recognizing the limitations of the model and by applying 
his experience, the research manager can gain information 
on the workings of his programo If a "yardstick" is 
available to measure research output in order to bring 
greater accuracy to the Pj_js, then this technique will be 
of great interest o 
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APPENDIX T 



GLOSSARY 



Attribu te « A reason for support of a catef^ory and a 
working level translation of a portion of the mission (ob“ 
iective) of ONRo Hopefully^ it is quantifiable t 

Balanced Program « That program which includes an 
aoDrooriate amount of effort in everv field of service in 
which we may reasonably be expected to engage is a balanced 
urogram^ The operative factors are therefore the list of 
services required by the ONR Mission (i»eos Objectives) and 
the proportions of the total effort to be devoted to eacho 
Boundary Conditions « The constraints on allocation of 
resources to categories o 

Categor y - A research effort composed of a set of 
tasks which have a common center of interesto The division 
is one which should provide a unit conveniei t for planning 
purposes , rather than being related to description of the 
total program as in the case of "proj ects’* and ”sub=projects o " 
Mission - The job imposed by orders; instructions « 
directives, and the like» In using the term; it should be 
made clear what group is being referred to, as **Mavy Mission 
etCo The ONR Mission is defined in complete detail by ONR 
Instruction 5430olB of 16 August 1961(, 

^Ad Hoc Research Planning Committee at the Office of 
Naval Research 
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Objectives - A more detailed description of the ONR 



Mission^ An objective is thus one of the services j the 
sum of which constitute the OMR Mission. 

Pro gram - Used without an adjective j the sum total of 
the efforts directed toward accomplishment of the ONR 
Mission. The Research Program is that uortion of the effort 
which is under the cof^nizance of the Assistant Chief for 
Research « 

Project - The long- "ange effort of a developing agency 
which extends over the full time span of the develooment of 
a system, or that which constitutes classes of work that 
continue indefinitely. Each project apoears as a line 
item in the Annual Navy RDTSE Program. (Definition required 
by DOD Directive 5200.10, 1 August 1962). See also "category", 
"subDroject" . 

Req uirement - A nlan or statement indicating the need 
or demand for personnel, equipment, suoolies, resources, 
facilities or services bv specific quantities, for specific 
neriods of time or at a specific time (JCS Pub. 1). 

Research Planning - The process of defining courses 
of action to be employed in achieving an effective and 
balanced research program and the communication of this process 
to other interested organizations. The selection of courses 
of action through a systematic consideration of alternatives. 



63 



Technological Barrier - An area of ignorance that 



prevents the development of a desired end item or capability ^ 
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APPENDIX II 



DETAILED PROBLEM ONE FORMULATION 



Anoendix two consists of the intermediate steps in- 
volved in solving oroblem one« They are provided to assist 
the reader in reproducing these same results o The notation 
used may be found in Garvin [l]o 

FORMULATION FOR COMPUTATION BY SIMPLEX METHOD OF PROBLEM I 
Maximixe [1 («399x5 + t240x + c262 x + o471 x +o521 x 

+c311 X + ol45 X + o234 X + t372x + „372 x ) ] 
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X^e-LE 15 FimAvL- TaBLE/^U of OPTIMA-L- SOLUJiChl Of 'PT^OBLfr.M ONE 





Table 16o Inverse of optimal basis of problem oneo 
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Table 17, Inverse of alrernate ontirrial has ■ s rf nroblcm 
one 0 
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A P PE' Ml) IX .1x1 



Examples of Attributes* Branches,, Catcf^ori*-s -an-'l P l s = si f i - 
cation Svstem reprinted from the Ad lioc Research Pl^nranp 
Committee Report „ 



List of Some Existing Attributes - Not Independent 
lo Scientific value 
2 (. Military value 
3 6 Technological value 
4„ ’Windows 
5o Eissemina t ion 
6o Coordination of Research 
7 6 Prestige 

8o Contract with Scientific Community 
9 <1 Pressures and interests 

10 « Existance of adequate programs within other ’" verrmert 
agencies 

llo Industrial incentive 

Partial List of ONR Branches 
lo Acoustics Branch 
2o Ceorgraphy Branch 
3o Geophvsics Branch 
4„ Field Projects Branch 
5c, Metallurgy Branch 
6. Chemist r''’ Branch 
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7. Pronulsinn Cho.mis trv Prarrh 
8o PoiA?er Branch 
9o Physics Branch 
10 o Unclear Phvsics Branch 
11 „ Electronics Branch 
12 0 Mathematics Branch 

13„ Lo?,istics and Mathematical Statistics branch 

IPi Information Systems Branch 

15o Fluid Dynamics Branch 

16^ Structural Mechanics Branch 

17 0 Physiology Branch 

18 0 Biochemistry Branch 

19c Microbiology Branch 

20. Medicine and Denistry Branch 

21c Biology Branch 

22 o Group Psychology Branch 

23. Physiological Psychology Branch 

24. Engineering Psychology Branch 
25c Personnel and Training Branch 

BreaVdown of Electronics oranch into Ca'’~~n- 

ELECTRONICS BRANCH 

A reas of New Emphasis 

a. Submarine Detection 
be Communications 
Communications Theory 



; -r X 0 S 
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Ciir rje n t Program categorie s 

a. Circuit Analysis and Synthesir 
bo Information Theory and Codint’ 

Co Dala Processing 
d. Bio-Electronics 
Physical Electronics 

Curren t Prog ra m Categories 

ao Solid State Electronics 

bo Cathode Characte'‘“istics (Thermionics Field 
Co Electron Ballistics 
do Plasma Studies 

Electromagnetic V/ave Propcgation and kadiation 
Current Program Categories 



ao Anomalous Propagation Modes 
bo VLF and ELF 
Co Antennas 
do Geomagnetics 
Co Direction Finding 
Electronic Components 

Current Program Categories 

Solid State Devices 
bo Microelectronics 
Co Electron Tubes 
do Application of New Materials 
Radio Astrophysics 

Current Program Categories 



as Solar Flare Studies 
b. Radio Source Positioning 
Co Cosmology via Radio Astronomy 
do Planetary Astronomiy 



f missio 
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Examples of Classification Systems Now In Use 



1 0 Chronological 

Ao Short Range 
Be Intermediate Range 
Ca Long Range 
De Other or combination 

He ENVIRONMENTAL (Spatial) 

Ae Aero Space 

Bo Surface (Water,, Land, Amphibious) 
Co Underseas (ASW, Mining Submarine) 
Do Other or combination 

IIIo CONVENTIONAT. SHIPBOARD 

Ao Engineering 
Bo Operations 
Co Deck 
Do Ordnance 
Eo Aviation 
Fo Medical/Dental 
Go Supply 

Ho Other or combinations 

IV 0 OFFENSIVE/DEFENSIVE 

Ao Offensive 

Bo Defensive 

Co Other or Combination 

Vo FUNCTIONAL OPERATIONAL 

Ao Surveillance 
Bo Command control 
Co Intelligence 
Do Nullification 
Eo Delivery Platform 
Fo Logistics 
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VI. .CAl£.G.QiiI£.S-. 

A. Earth Sciences 
Bo Material Sciences 
Co Physical Sciences 
Do Mathematical Sciences 
Eo Biological Sciences 
Fo Psychological Sciences 
Go Ooerations Analysis 
Ho Other or combinations 

VII 0 FUNCTIONAL BY BROAD MISSIOH 

Ac Applied Research 
Bo Basic Research 

Co Development Test 8 Evaluation 
Do Management S Support 

VIIIo BUDGET ACTIVITY (End Item Categories) 

Ao Military Sciences 
Bo Aircraft and Related Equipment 
Co Missives and Related Equipment 
Do Ast. onautics 
Eo Ships and Small Crafi 
Fo Ordnance Combat Vehicles 
Go Other Equipment 

Ho Program Wide Management Supporet 
lo Military Family Housing 
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